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(54) MEDICAL TREATMENT SUPPORTING DEVICE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To make it possible to back 
up information regarding hospitalized patients from a 
remove place, by providing an image processing unit, 
which takes pictures of specified objectives around a 
bed and applies a specified process to the photographed 
image, a measured amount detecting part, which reads 
feature amount of the objective from the processed 
image, and a quantitative detecting part, which compares 
the feature amount with a set value. 
SOLUTION: An image processing part 1 including an 
image sensor for which an artificial retina chip, etc., are 
used, fetches an image with a medical equipment around 
a bed as its center. For example, an image of an image 
range 8 for which the liquid level 9 of a cylinder 7 for 
drip, is uptaken, and an edge treatment is applied. Then, 
in a measured amount detecting part 2, respective 
picture element values of an output image (the edge 
treated image) of the image processing part 1 are 
projected in the horizontal direction, and the histogram 

of the picture element values regarding the vertical direction of the image, is obtained, and a 
coordinate value which takes a maximum value is output. This output value corresponding with 
the residual amount of a present drip. Finally, in a quantitative detecting part 3, the output value 
of the measuring detecting part 2 and a threshold value are compared, and a present residual 
amount of the drip, and a message to show the completion of the drip are output to a nurse 
center, etc. 
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* NOTICES * 

iTPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] Medical exchange equipment characterized by to have the image-processing section which 
photos the inpatient's in a hospital specific object of the bed circumference, and performs 
predetermined processing to a photography image, the measuring detecting element which reads the 
target characteristic quantity in the processing image of the above-mentioned image-processing 
section, and the quantum detection section which detects whether the characteristic quantity which 
the above-mentioned measuring detecting element read reached the set point. 
[Claim 2] The medical exchange equipment carry out having had the quantum evaluation section 
which changes into the characteristic quantity for operating the object which exists around a patient 
the actuation which has recognized in the image-processing section which photos the inpatient of the 
predetermined location in a hospital and performs predetermined processing to a photography image, 
the recognition section of operation which recognize actuation of a patient from the processing 
image of the above-mentioned image-processing section, and the above-mentioned recognition 
section of operation as the description. 

[Claim 3] The image-processing section which is attached in an inpatient's machine for migration in 
a hospital, photos a patient's circumference, and performs predetermined processing to a 
photography image, It is medical exchange equipment characterized by having the transit control 
actuator section which corrects a travelling direction in order to avoid the above-mentioned 
obstruction, when a travelling direction is determined from the actuation recognized in the 
recognition section of operation which recognizes actuation of a patient from the processing image 
of the above-mentioned image-processing section, and the above-mentioned recognition section of 
operation and an obstruction is in a travelling direction. 

[Claim 4] The image-processing section which is attached in two or more predetermined locations in 
a hospital, photos the inpatient who moves, performs predetermined processing to a photography 
image, and extracts the above-mentioned patient's description section, Medical exchange equipment 
characterized by having the patient specification section which specifies the patient who memorized 
two or more patients 1 description section, and was photoed in the above-mentioned image-processing 
section based on the information on the memorized description section, and the patient-monitering 
section which supervises the migration situation in the hospital of the patient specified in the above- 
mentioned patient specification section. 

[Claim 5] The image-processing section which photos the sickroom of the ward for inpatients in a 
hospital, and performs predetermined processing to a photography image, The behavior detecting 
element which detects the motion in a sickroom from the processing image of the above-mentioned 
image-processing section, If the motion which analyzed the image of an image field including the 
motion detected by the above-mentioned behavior detecting element, memorized the behavior 
specification section which distinguishes a motion of a patient or except [ its ], and two or more 
patients' description section, and was specified in the above-mentioned behavior specification 
section is a motion of a patient Medical exchange equipment characterized by having the patient 
specification section which specifies the patient in the above-mentioned image field based on the 
information on the memorized description section. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the medical exchange equipment which supervises 
exchange of an activity of everything of an inpatient in a hospital, and an inpatient's situation. 
[0002] 

[Description of the Prior Art] That to which what is considered as a medical support system in a 
hospital supports those with two, and one supports the activity of an inpatient's every day, and 
another have some which support an inpatient's monitor. 

[0003] As a former example, the support system to various miscellaneous affairs, such as 
temperature monitoring with which the inpatient was burdened, a termination report of intravenous 
drip, etc. in a hospital, is mentioned. Although these miscellaneous affairs can receive assistance of a 
nurse if needed, in many cases, the termination report of intravenous drip etc. is left to the patient, 
for example, and a trouble may occur. Although the nurse should always supervise ideally, in order 
to nurse many inpatients by a small number of nurse, it is next to impossible to supervise each 
patient's intravenous drip termination in the hospital of a labor shortage. As a conventional example 
of the system which supports the miscellaneous affairs in a patient's bedside circumference, there is a 
patient monitor system as shown, for example in JP,4-327832,A. Although an image including a 
patient is supervised with a camera in this system, the range to supervise was comparatively wide 
range, and since specific objects, such as intravenous drip, are not supervised and it was not further 
accompanied by the image processing, it was difficult [ it ] to detect volume change of intravenous 
drip. 

[0004] Moreover, it is necessary to adjust the inclination of a bed etc. frequently for a bedridden 
elderly. Although this can also receive assistance of a nurse if needed, when a nurse is busy, it is next 
to impossible like the above. Moreover, in the electric controllable bed with which a patient can 
adjust an inclination by himself, although adjusted to the delicate inclination for which a patient asks 
using a device, it is desirable that it can control easily using a gesture etc., without using such a 
device. However, the bed with which such a controlling mechanism was incorporated is not realized. 
When changing one's clothes furthermore, it is necessary to shut the curtain of the bed circumference 
and a help of a nurse or a person looking after a patient cannot be obtained, it is forced to rise from a 
bed and to close by itself, and the burden to a patient is large. 

[0005] Moreover, an inpatient is often required to go to the laboratory which left sickrooms, such as 
an X-ray and CT medical checkup, in addition to the above-mentioned miscellaneous affairs. When a 
nurse escorts, it is good, but when a patient goes with a wheelchair by himself, it is serious 
difficulties to reach with a wheelchair to the distantly distant laboratory in a large hospital. 
Moreover, when it has trouble in a hand, a helper is surely required. Moreover, in a current electric 
wheelchair, although a patient operates a device and is controlling advance, it is desirable that it can 
control easily using a gesture etc., without using such a device. However, the wheelchair with which 
such a controlling mechanism was incorporated is not realized. 

[0006] On the other hand, there is a monitor of the Innai walk advanced to a patient for the purpose 
of rehabilitation etc. as an example of the latter which supports an inpatient's monitor. As a 
conventional example relevant to the supervisory equipment of the Innai walk, there is abnormality 
monitoring system in JP,2-7195,A, for example. In this system, the specific supervised area in a 
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home for the aged, a hospital, etc. is supervised with a video camera, the difference of the image 
memorized beforehand and the image of the present time of day can be taken, if that difference 
exceeds a specific threshold, it can say that abnormalities are sensed, and abnormalities, such as a 
patient f s anomalous behavior and a fire, can be told [ consequently ]. however, the difference of the 
image which serves as a criterion which tells abnormality sensing when using this system as 
supervisory equipment of the Innai walk — the patient who walks Innai cannot be specified only with 
a value. Therefore, while walking the inside of a hospital, a prompt action when a sudden fit, 
accident, etc. happen was not completed. 

[0007] Moreover, although the ward monitor of Nighttime is made because a nurse goes round, in 
many cases, this is a small number of nurse f s round, a patient may stop being in patrolling the whole 
over all night in a big ward from the sickroom except giving a nurse a burden and a nurse going 
round, and a trouble may produce it in locations other than a sickroom. In order to avoid this, when it 
is equipped with the camera for a monitor for every sickroom and an accident arises, a system which 
judges it from an image and tells automatically of which sickroom it is an accident is required. 
[0008] Drawing 19 is the explanatory view showing the medical exchange equipment using the 
conventional image sensor shown in JP,5-161613,A, and is exchange equipment for supervising the 
condition of the patient on a bed. In drawing, the fiber grating which 1 5 divides into a 2-dimensional 
grid-like pattern the infrared laser light which carried out incidence, and carries out outgoing 
radiation of the spot beam, and 16 are frame memories which capture the image with which a spot 
beam and 17 photoed the patient on a bed, and 18 photoed the reflective spot beam. The location 
data of the reflective spot beam 19 in the condition that there is no patient on a bed according to this 
equipment, By comparing with a frame memory the location data of each reflective spot beam 20 
memorized for every fixed time amount, detecting a migration spot, and recognizing the ** absent of 
the patient on a bed, a location, and a near motion from the migration situation of this spot A 
patient's condition is supervised, such as judging automatically the case where a patient will be in a 
normal condition. However, it was difficult to use as a system which the medical exchange 
equipment using the above conventional image sensors becomes large-scale inevitably, is not 
suitable for using as supervisory equipment of the patient of all sickrooms, and supports a sickroom 
monitor. 
[0009] 

[Problem(s) to be Solved by the Invention] As mentioned above, there were various troubles, using 
the image sensor, every patient's bed circumference supervised and the conventional equipment 
which supports the activity of an inpatient's every day was expected the equipment which reads a 
demand of a patient in actuation of a patient and supports the activity. However, since conventional 
medical exchange equipment as shown, for example in drawing 19 was large-scale, a fine image 
change of intravenous drip termination etc. could not be detected, or change of local images, such as 
a motion of a hand, could not be detected, and the system which is difficult for using as a support 
system of an activity an inpatient's every day, and supports an activity of everything of an inpatient 
finely was not realized. Moreover, also in the conventional equipment which supports an inpatient's 
monitor, since a patient was not able to be specified from a face image etc., there is no system which 
always grasps the motion of the patient in a hospital and a sickroom, and only the inadequate 
monitor of it was completed. 

[0010] This invention is made in order to cancel the above troubles, and it aims at offering the 
equipment which supports finely an activity of everything about an inpatient's bedside or the Innai 
migration by detecting change of the condition of the medical equipment of the bed circumference 
certainly, or detecting actuation of a gesture etc. Moreover, grasp of the behavior of the inpatient of 
sickrooms, such as grasp of the location of the inpatient who is moving in the inside of a hospital, or 
Nighttime, etc. is aimed at offering the equipment which supports the monitor of everything about a 
patient by detecting a motion of the patient in a hospital and a sickroom. 
[0011] 

[Means for Solving the Problem] The medical exchange equipment by the 1 st configuration of this 
invention photos the inpatient's in a hospital specific object of the bed circumference, and is 
equipped with the image-processing section which performs predetermined processing to a 
photography image, the measuring detecting element which reads the target characteristic quantity in 
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the processing image of the above-mentioned image-processing section, and the quantum detection 
section which detects whether the characteristic quantity which the above-mentioned measuring 
detecting element read reached the set point. 

[0012] The medical exchange equipment by the 2nd configuration of this invention photos the 
inpatient of the predetermined location in a hospital, and it has the quantum evaluation section which 
changes to the characteristic quantity for operating the object which exists around a patient the 
actuation which has recognized in the image-processing section which performs predetermined 
processing to a photography image, the recognition section of operation which recognizes actuation 
of a patient from the processing image of the above-mentioned image-processing section, and the 
above-mentioned recognition section of operation. 

[0013] The image-processing section which the medical exchange equipment by the 3rd 
configuration of this invention is attached in an inpatient's machine for migration in a hospital, 
photos a patient's circumference, and performs predetermined processing to a photography image, A 
travelling direction is determined from the actuation recognized in the recognition section of 
operation which recognizes actuation of a patient from the processing image of the above-mentioned 
image-processing section, and the above-mentioned recognition section of operation, and when an 
obstruction is in a travelling direction, in order to avoid the above-mentioned obstruction, it has the 
transit control actuator section which corrects a travelling direction. 
[0014] The image-processing section which the medical exchange equipment by the 4th 
configuration of this invention is attached in two or more predetermined locations in a hospital, 
photos the inpatient who moves, performs predetermined processing to a photography image, and 
extracts the above-mentioned patient's description section, It has the patient specification section 
which specifies the patient who memorized two or more patients 1 description section, and was 
photoed in the above-mentioned image-processing section based on the information on the 
memorized description section, and the patient-monitering section which supervises the migration 
situation in the hospital of the patient specified in the above-mentioned patient specification section. 
[0015] The image-processing section which the medical exchange equipment by the 5th 
configuration of this invention photos the sickroom of the ward for inpatients in a hospital, and 
performs predetermined processing to a photography image, The behavior detecting element which 
detects the motion in a sickroom from the photography image of the above-mentioned image- 
processing section, If the motion which analyzed the image of an image field including the motion 
detected by the above-mentioned behavior detecting element, memorized the behavior specification 
section which distinguishes a motion of a patient or except [ its ], and two or more patients' 
description section, and was specified in the above-mentioned behavior specification section is a 
motion of a patient Based on the information on the memorized description section, it has the patient 
specification section which specifies the patient in the above-mentioned image field. 
[0016] 

[Embodiment of the Invention] 

Gestalt 1. drawing 1 of operation is the block diagram showing the configuration of the medical 
exchange equipment by the gestalt 1 of operation of this invention, and consists of three parts of the 
image-processing section 1, the measuring detecting element 2, and the quantum detection section 3. 
The image-processing section 1 containing an image sensor captures the image centering on the 
medical equipment which exists on a patient's the outskirts of a bed, and performs edge processing to 
a photography image. As an example of the image sensor used with the gestalt of this operation, it is 
magazine "optical" 1996 year 25 volume 5 No. There is an artificial retina chip carried on 273-274 
pages. This image sensor can perform processing facilities, such as random access pattern matching 
of not only an image pick-up function like usual CCD but an edge detection and an image field, on a 
chip, and does not need large-scale arithmetic circuits, such as a computer conventionally needed for 
equipment. The example of such an artificial retina chip is shown in drawing 2 . As for a sensibility 
variable cell and 22, in drawing 2 ,21 is [ an input circuit and 23 ] output circuits. By inputting a 
predetermined control signal into two or more sensibility variable cells 21 arranged by the two- 
dimensional configuration from an input circuit 22, to the input image W, various image processings, 
such as random access pattern matching of edge detection and an image field, can be performed on a 
chip, and the processing image J is obtained through an output circuit 23. The measuring detecting 
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element 2 projects each pixel value of the output image (edge processing image) from the image- 
processing section 1 in the fixed direction, and outputs the coordinate of the horizontal position 
where the value serves as max as characteristic quantity. It judges whether based on the output 
coordinate of the measuring detecting element 2, it is less than the quantum detection section 3 from 
the coordinate value set up beforehand. 

[0017] As medical equipment of the patient circumference in the gestalt of this operation, 
intravenous drip is explained as an example. First, the image-processing section 1 captures the image 
of the image range 8 centering on the oil level 9 of the cylinder 7 of intravenous drip, as shown in 
drawing 3 (a), and edge processing i s ****i n ****. The level line in an image is adjusted by this 
edge processing. Since the oil level in the cylinder of intravenous drip is always level, by the image 
by which edge processing was carried out as shown in drawing 3 (b), an oil level is always 
emphasized (the value of a corresponding pixel value is large). 

[0018] Next, the measuring detecting element 2 projects horizontally each pixel value of the output 
image (edge processing image) of the image-processing section 1, obtains the histogram of the pixel 
value about the vertical direction of an image like drawing 3 (c), and outputs the coordinate value 
(arrow-head location of drawing 3 (c)) V which takes maximum. As mentioned above, the oil level 
in a cylinder is always level, and since it is emphasized by edge processing, this output value V 
supports the residue of current intravenous drip. 

[0019] Finally, the quantum detection section 3 performs the comparison with the output value V of 
the measuring detecting element 2, and threshold T, if it becomes V>T, it will output the current 
intravenous drip residue calculated from V, and if it becomes V<=T, it will output the message 
which shows termination of intravenous drip to a patient or a nurse center. 

[0020] As mentioned above, intravenous drip termination is automatically detectable from the image 
which photoed the intravenous drip of the patient circumference. In addition, although the gestalt of 
the above-mentioned implementation showed what photos intravenous drip as medical equipment of 
the patient circumference, also when opening and closing a curtain automatically as other application 
in a bedside according to the strength of the sunlight inserted from an aperture, it is possible to apply 
the equipment in the gestalt of this operation. That is, since the contrast of the shadow of the window 
frame projected on the floor of a sickroom etc. is strong when strong sunlight shines in, it can detect 
from the edge processing image of the gestalt of this operation of this, and automatic closing motion 
of the curtain can be carried out according to the strength of sunlight. 

[0021] Gestalt 2. drawing 4 of operation is the block diagram showing the configuration of the 
medical exchange equipment by the gestalt 2 of operation of this invention, and consists of three 
parts of the image-processing section 1, the recognition section 4 of operation, and the quantum 
evaluation section 5. The image-processing section 1 containing an image sensor captures an image 
including actuation of a patient, performs predetermined processing, and obtains an edge image. By 
using the above-mentioned artificial retina chip as an image sensor here, an edge processing image is 
easily obtained as an output image. The recognition section 4 of operation classifies actuation of a 
patient from the processing image of the image-processing section 1 . The quantum evaluation 
section 5 is changed into a parameter required for object control of the patient circumference 
according to the classification of the recognition section 4 of operation. 

[0022] The gestalt of this operation explains the example which adjusts the inclination and height of 
a bed according to a gesture. First, in the image-processing section 1, an image including a motion of 
a hand is captured and edge processing is performed. The recognition section 4 of operation analyzes 
a motion of the processed image, distinguishes whether it is the signal of inclination change or height 
change, respectively, and changes into the parameter of include-angle change or height change, 
respectively it in the quantum evaluation section 5. [ it ] Drawing 5 is a flow chart which shows 
actuation of the medical exchange equipment by the gestalt of this operation, and drawing 6 is an 
explanatory view for explaining this flow chart. The image-processing section 1 captures an image 
including a motion of drawing 6 (a) or a hand as shown in (b) (step ST 1). The recognition section 4 
of operation calculates an optical flow as shown in drawing 6 (c) or (d) to a motion of each hand to 
the processing image outputted from the image-processing section 1 (step ST 2). This optical flow 
count is calculable using the algorithm of the optical flow in the migration object-recognition 
approach of a publication to JP,4-241077,A. Furthermore, in order that the recognition section 4 of 
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operation may detect the inclination change or height change of a bed about accommodation It has 
the rotation detection filter or advancing-side-by-side detection filter of an optical flow as shown in 
drawing 6 (e) or (f), respectively. It applies to the optical flow which had each above-mentioned 
filter calculated, respectively (steps ST3 and ST4), and the value of each application value R and F 
acquired as a result is compared, and it inclines or judges whether it is height change (steps ST5- 
ST10). Each arrow head in an optical flow and a filter is regarded as a vector, and an inner product is 
calculated between the vectors which correspond in location, and, specifically, let total of the inner 
product value acquired as a result be each filter application value R and F. These values turn into a 
reference value of how many advancing-side-by-side components [ a rotation component or ] are 
contained in an optical flow, if it becomes R>F to the application value of these filters (step ST 5) 
and R will exceed a threshold TR (step ST 6) — the recognition section 4 of operation — inclining — 
change and a judgment (step ST 8) — otherwise, — coming — if F exceeds threshold TF (step ST 7), it 
will judge with height change similarly (step ST 10). It judges with having no change except these 
(step ST 9). In response to these results, the quantum evaluation section 5 outputs the include-angle 
change value (step ST 1 1) or height change value (step ST 12) for accommodation of the bed 
proportional to the filter application values R or F. Drawing 7 and drawing 8 show that the 
inclination ( drawing 7 (b)) or height ( drawing 8 (b)) of a bed is adjusted according to the parameter 
extracted from the motion of a hand as shown in drawing 7 (a) and drawing 8 (a) by the quantum 
evaluation section 5. 

[0023] As mentioned above, it becomes possible by photoing actuation of a patient by the image 
sensor and changing into the parameter for object control to control an object, without a patient 
applying the force. 

[0024] Moreover, the equipment by the gestalt of this operation can also be applied to closing 
motion of a curtain instead of accommodation of a bed, and becomes able [ a patient ] to open and 
close a curtain, gone closing motion of a curtain to sleep on a bed by [, such as a gesture, ] moving a 
patient's specific part. 

[0025] In addition, although the image sensor was considered as the artificial retina chip, the edge 
processing image was obtained and optical flow count was carried out in the recognition section 4 of 
operation in the gestalt of the above-mentioned implementation, not using such an image sensor, 
direct optical flow count may be carried out from the photography image using the usual image 
sensor. 

[0026] Gestalt 3. drawing 9 of operation is the block diagram showing the configuration of the 
medical exchange equipment by the gestalt 3 of operation of this invention, and consists of three 
parts of the image-processing section 1, the recognition section 4 of operation, and the transit control 
actuator section 6. The gestalt of this operation explains the example which steers by gesture the 
wheelchair used in case a patient moves in the inside of a hospital. First, the image-processing 
section 1 containing an image sensor photos an image including the actuation which a patient like 
drawing 10 (a) shows, and performs predetermined processing to a photography image. Here, an 
edge processing image is obtained as an output image like the gestalt 2 of operation, using for 
example, an artificial retina chip as an image sensor. Next, the recognition section 4 of operation 
extracts the direction of empty vehicle chair steering of a patient of operation. For example, an 
optical flow like drawing 10 (b) is calculated to the output image from the image-processing section 
1 like the gestalt 2 of operation, and it considers that each arrow head of an optical flow is a vector, 
and asks for total of a vector from the whole optical flow, and when the die length of this total vector 
exceeds the threshold set up beforehand, it considers as the steering direction which searches for the 
direction which a total vector has. It is also possible to make the direction of an average of a motion 
vector into the steering direction. 

[0027] The transit control actuator section 6 determines the direction to which a wheelchair goes 
based on the extracted steering direction. Moreover, when an obstruction exists in the direction 
shown in actuation of a patient, the distance ahead of the decision direction which can be gone on is 
measured with the distance measuring equipment of the transit control actuator section 6, and a 
travelling direction is corrected based on measurement distance. Drawing 1 1 and drawing 1 2 are the 
flow charts and explanatory views showing actuation of a transit control actuator section. With the 
gestalt of this operation, the transit control actuator section 6 equips right and left of a wheelchair 
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with the image pick-up equipments (it is called a right-and-left eye below) al and a2 like drawing 1 2 
(a), picturizes an image by this, and stores image data IL and IR about each right-and-left eye (step 
ST 21). Furthermore, the transit control actuator section 6 equips the location of a3 with the spot 
light irradiation device which irradiates an obstruction among drawing 12 (a), and can irradiate spot 
light from the overhead location of human being in a wheelchair to the obstruction which exists in 
the steering direction. a4 shows the direction of radiation of spot light. a5, a7, and a9 show human 
being standing on the locations A, B, and C along the travelling direction of a wheelchair among 
drawing, respectively. a6 and a — 8 and 10 show the spot light exposure location in case human 
being stands on locations A, B, and C, respectively. Furthermore, since the bearing of the exposure 
axis of a right-and-left eye crosses as shown in al 1 and al2, the spot light exposure locations in 
[ above-mentioned ] three differ on the image of a right-and-left eye. After irradiating spot light (step 
ST 22), again, a right-and-left eye picturizes the image containing spot light, and stores image data 
IL* and IR* (step ST 23). and the difference of the image data stored about each right-and-left eye — 
IL*-IL and IR*-IR are calculated. The exposure location of spot light can be pinpointed by being 
able to specify a part with a strong brightness value by carrying out binarization of these subtraction 
images with the threshold set up beforehand, for example, calculating the center-of-gravity location 
(step ST 24). O mark in drawing 12 (b) and + mark in drawing 12 (c) show the spot light exposure 
location in case human being specified about the right eye and the left eye stands on locations A, B, 
and C, respectively. The distance to an obstruction (the gestalt of this operation human being) can be 
presumed by taking into consideration a gap of the specific location of the spot light of this right- 
and-left eye. The gap vector which goes to a right eye specification location from the left eye 
specification location of a spot light exposure location here is calculated (step ST 25). or [ keeping 
away by drawing 12 (d's) - f s (f s)'s expressing the gap vector corresponding to locations A, B, and C, 
respectively, corresponding to a long distance, when a gap vector is facing the right, and 
corresponding at a short distance in a leftward case ] — or it shifts and the die length of a vector also 
increases as it approaches. From this, in consideration of the sense (step ST 26) of a gap vector, in a 
rightward case, it bypasses to rectilinear propagation, and as it is (step ST 27), when that is not right, 
it bypasses to the left (step ST 28) or the right. A patient may enable it to choose this detour by 
button grabbing etc., and may set it to the left or the right beforehand. 

[0028] In addition, although the gestalt of the above-mentioned implementation explained the 
example which steers by gesture the wheelchair used in case a patient moves in the inside of a 
hospital, the means which shows a travelling direction can also be shown by moving the head 
besides a gesture. Moreover, with the gestalt of the above-mentioned implementation, although the 
transit control actuator section 6 measured detection of the obstruction of a travelling direction, and 
the distance to the above-mentioned obstruction by the approach as shown in drawing 12 , it may 
detect the phase contrast of the outgoing radiation light to a travelling direction, and the reflected 
light by the obstruction of this light, and may measure the distance to an obstruction and the above- 
mentioned obstruction. 

[0029] As mentioned above, when a patient shows the travelling direction of a wheelchair by gesture 
etc., it can steer without applying the force to a wheel, and when it has trouble in a hand, steering 
becomes possible by the direction being shown with the head. Furthermore, in rectilinear- 
propagation transit, such as a passage, once is sufficient as direction directions, they can cope with it 
by measuring the distance to an obstruction and adjusting a travelling direction automatically, also 
when an obstruction exists on the way, and the burden of wheelchair operation of a patient can be 
mitigated as much as possible. 

[0030] In addition, although the image sensor was considered as the artificial retina chip, the edge 
processing image was obtained and optical flow count was carried out in the recognition section 4 of 
operation in the gestalt of the above-mentioned implementation, not using such an image sensor, 
direct optical flow count may be carried out from the photography image using the usual image 
sensor. 

[0031] Gestalt 4. drawing 13 of operation is the block diagram showing the configuration of the 
medical exchange equipment by the gestalt 4 of operation of this invention, and consists of three 
parts of the image-processing section 1, the patient specification section 10, and the patient- 
monitering section 1 1 . The image-processing section 1 containing an image sensor captures an image 
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including the patient 14 who moves like d rawing 14 in the inside of a hospital. The above-mentioned 
artificial retina chip is used as an example of the image sensor used with the gestalt of this operation. 
Here, an output image is obtained using the pattern-matching function of an artificial retina chip. The 
patient specification section 1 0 can specify the inpatient in the photoed image by memorizing 
beforehand a patient's description section obtained from person images extracted based on a patient's 
label and a patient's image, such as height and a form, to two or more patients, and collating and 
carrying out pattern matching of these, and the person image and label in the image photoed in the 
image-processing section. The patient-monitering section 1 1 monitors room according to patient 
continuously based on the installation location of an inpatient's information specified in the patient 
specification section 10, and the image sensor which picturized this. Drawing 15 is the patient PI 
who is moving a specific story, P2, and P3. The surveillance intelligence of the related patient- 
monitering section 1 1 is expressed. By attaching in head lining, a side attachment wall, etc. of the 
stairway in the hospital which prepares two or more above-mentioned artificial retina chips, and is 
shown by drawing 1 5 , or a passage, namely, about the patient PI in drawing 1 5 He is a patient PI 
about the installation location of the artificial retina chip with which a patient's description section 
detected using the above-mentioned pattern-matching function among the images caught with the 
artificial retina chip attached in head lining of the passage during a walk two or more places serves 
as max. It judges with an existence point. The direction to move is acquired by comparing it of the 
location detected at last time of day, and the present time of day. [0032] As mentioned above, the 
medical exchange equipment of the gestalt of this operation can monitor continuously room of the 
patient who moves in the inside of a hospital, and, thereby, can respond to a patient's emergency 
promptly. 

[0033] Gestalt 5. drawing 16 of operation is the block diagram showing the configuration of the 
medical exchange equipment by the gestalt 5 of operation of this invention, and consists of four parts 
of the image-processing section 1, the behavior detecting element 12, the behavior specification 
section 13, and the patient specification section 10. The image-processing section 1 containing an 
image sensor captures the image of the range which contains all the patients under sleeping in a 
midnight sickroom like drawing 1 7 . The artificial retina chip same as an example of an image sensor 
as the gestalt 4 of the above-mentioned implementation is used. The behavior detecting element 12 
detects which part in an image moved by taking the difference of the photography image photoed at 
last time of day, and that of the present time of day. 

[0034] The behavior specification section 13 analyzes the image in the image field where the motion 
was detected based on the location of the motion detected by the behavior detecting element 12, and 
distinguishes a motion of a patient or except [ its ]. Specifically, it distinguishes whether it is a 
motion of human being using the binarization image of the subtraction image calculated by the 
behavior detecting element 12. Hereafter, it explains using drawing 1 8 . The thing and drawing 18 
(c) to which the example of the image with which drawing 18 (a) includes a motion of human being, 
and drawing 18 (b) carried out binarization of the subtraction image are a histogram which takes the 
pixel value of a binarization image horizontally and is obtained in total. This histogram is reflecting 
the strength of the motion detected by each vertical position, and, other than this, or can be 
distinguished from having a bias compared with the case where it is change of mere lighting 
conditions in case human being is not in the histogram corresponding to human being's head, a 
motion of a guide peg, etc. in a motion of a patient by setting up the following conditions, for 
example. Namely, threshold TO the peak value of a histogram is indicated to be by the dotted line 
When exceeding, it is the vertical position HI and H2. For example, Kl and K2 When it is outside 
the trisection location (trisection location to a binarization image) of two perpendicularly it is shown, 
it judges with their being a motion of human being, as a result a motion of a patient. 
[0035] If the motion specified in the behavior specification section 13 is a motion of a patient, the 
patient specification section 10 is performing pattern matching for the above-mentioned patient in 
the image field where the motion was detected like the gestalt 4 of operation using the pattern- 
matching function of an artificial retina chip, and specifies a motion [ which patient ] it is. 
Consequently, there are few amounts of image processings and they end rather than it performs 
pattern matching to all the range of an image. By supervising a motion continuously as mentioned 
above, also when the motion in a patient's sickroom can be detected and a patient leaves the room, it 
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is possible to specify which patient left by following the motion location currently recorded 
continuously. 

[0036] As mentioned above, by monitoring a sickroom continuously, the behavior of everything of a 
patient can be supervised, a motion of the patient under sleeping and the patient who comes out of 
the room at midnight etc. can be grasped, and the burden of the nurse of a late night shift can be 
mitigated especially. 
[0037] 

[Effect of the Invention] The image-processing section which photos the inpatient's in a hospital 
specific object of the bed circumference, and performs predetermined processing to a photography 
image according to the 1 st configuration of this invention as mentioned above, Since it had the 
measuring detecting element which reads the target characteristic quantity in the processing image of 
the above-mentioned image-processing section, and the quantum detection section which detects 
whether the characteristic quantity which the above-mentioned measuring detecting element read 
reached the set point Change of the condition of the medical equipment of the bed circumference can 
be detected certainly, and an activity of everything about an inpatient's bedside can be supported. 
[0038] Moreover, the image-processing section which according to the 2nd configuration of this 
invention photos the inpatient of the predetermined location in a hospital and performs 
predetermined processing to a photography image, Since it had the quantum evaluation section 
changed into the characteristic quantity for operating the object which exists around a patient the 
actuation recognized in the recognition section of operation which recognizes actuation of a patient, 
and the above-mentioned recognition section of operation from the processing image of the above- 
mentioned image-processing section An activity of everything about an inpatient's bedside is easily 
supportable with actuation of a gesture etc. 

[0039] Moreover, the image-processing section which according to the 3rd configuration of this 
invention is attached in an inpatient's machine for migration in a hospital, photos a patient's 
circumference, and performs predetermined processing to a photography image, The recognition 
section of operation which recognizes actuation of a patient from the processing image of the above- 
mentioned image-processing section, Since it had the transit control actuator section which corrects a 
travelling direction in order to avoid the above-mentioned obstruction, when a travelling direction is 
determined from the actuation recognized in the above-mentioned recognition section of operation 
and an obstruction is in a travelling direction, the Innai migration of an inpatient is easily supportable 
with actuation of a gesture etc. 

[0040] Moreover, the image-processing section which according to the 4th configuration of this 
invention is attached in two or more predetermined locations in a hospital, photos the inpatient who 
moves, performs predetermined processing to a photography image, and extracts the above- 
mentioned patient's description section, Since it had the patient specification section which specifies 
the patient who memorized two or more patients' description section, and was photoed in the above- 
mentioned image-processing section based on the information on the memorized description section, 
and the patient-monitering section which supervises the migration situation in the hospital of the 
patient specified in the above-mentioned patient specification section Since the location of the 
inpatient who is moving in the inside of a hospital can always grasp and can respond to a patient's 
emergency promptly, it can contribute to the safety management by the side of a hospital. 
[0041] Moreover, the image-processing section which according to the 5 th configuration of this 
invention photos the sickroom of the ward for inpatients in a hospital, and performs predetermined 
processing to a photography image, The behavior detecting element which detects the motion in a 
sickroom from the processing image of the above-mentioned image-processing section, If the motion 
which analyzed the image of an image field including the motion detected by the above-mentioned 
behavior detecting element, memorized the behavior specification section which distinguishes a 
motion of a patient or except [ its ], and two or more patients' description section, and was specified 
in the above-mentioned behavior specification section is a motion of a patient Since it had the patient 
specification section which specifies the patient in the above-mentioned image field based on the 
information on the memorized above-mentioned description section, a motion of the patient under 
sleeping and the patient who comes out of the room at midnight etc. can be grasped, and the burden 
of the nurse of a late night shift can be mitigated. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DRAWINGS 



Drawing 1] 



[Drawing 2] 



22 





&\ 






if 


6- 


6- 


6- 


6- 




6- 


6- 




d> 






6 


5J 


6 


6- 




6- 


6- 




6- 



2 1 



2 1 : f&&WE.*Jl> 
2 2 : A*H* 

2 3 : 



2 3 



[Drawing 3] 
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[Drawing 6] 
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[Drawing 7] 




(b) 




(b) 



[Drawing 9] 
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[Drawing 10] 
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[Drawing 1 8] 
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